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Abstract 



OO 

O 

o 

(N : Let X and Y be two independent random walks on 1? with zero mean and finite variances, and let 

\ Lt{X, Y) be the local time of X — F at the origin at time t. We show that almost surely with respect 

^ ' to y, Lt{X,Y)/ logt conditioned on Y converges in distribution to an exponential random variable 

with the same mean as the distributional limit of Lt{X, Y)/ logt without conditioning. This question 
arises naturally from the study of the parabolic Anderson model with a single moving catalyst, which 
is closely related to a pinning model. 
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1 Introduction 



It is a classical result dating back to Erdos and Taylor |ET60j that, for a simple random walk on Z^, if 
, Lt denotes its local time at the origin at time t, then Lf/logt converges in distribution to an exponential 
00 ', random variable as t ^ 00. With a change of parameter for the exponential random variable, the same 
' result holds for general zero mean finite variance random walks on Z^. More precisely, if X is either a 
■ discrete or a continuous time random walk on with zero mean, finite variance, and one-step increment 
distribution p{-), then its covariance matrix is defined by 

. Qij = p{x)xiXj, l<i,j<2. (1.1) 

^ ] Let Lt{X) = Yll=o^oi-^i) if is a discrete time random walk, and let Lt{X) = do{Xs)ds if X is a 
$_i ' continuous time random walk. Then the classical Erdos-Taylor result states that 

Theorem 1.1 [Erdos— Taylor] Let X be an irreducible zero mean finite variance random walk on 1? 
with covariance matrix Q starting at the origin. Let r denote the jump rate of X if it is a continuous 



time random walk, and set r = 1 otherwise. Then as t ^ 00, E 



/ 27rrVdet QL. 
V log* 



k\ for each € N, 



and ^^'^^ogf converges in distribution to a mean 1 exponential random variable. 



Remark. If X is not irreducible, but is still truly two-dimensional, then the sublattice in 1? which X 
visits with positive probabilty can be mapped linearly and bijectively to (see PI in Sec. 7 and P5 in 
Sec. 2 of Spitzer |S76j ). Theorem 1 1 . 1 1 can then be applied to the image random walk. 

If X and Y are two independent, but not necessarily identically distributed, irreducible zero mean 
finite variance random walks on Z^ such that X — Y is also irreducible, then Theorem 11.11 applies to 
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X — Y. This can be regarded as an averaged limit theorem for the local time Lt{X,Y) := Lt{X — Y), 
where Y plays the role of the random environment. The objective of this paper is to obtain a quenched 
limit theorem for Lt{X,Y), i.e., a limit theorem for Lt{X,Y) conditioned on Y. 

For future reference, let P;^(-) denote probability w.r.t. the random walk X starting from x, and let 
E;^[-] denote the corresponding expectation. 

Theorem 1.2 [Quenched exponential law] Let X and Y he independent irreducible zero mean finite 
variance random walks on 1? starting from the origin, such that Z := X — Y is also irreducible. Let 
Q be the covariance matrix of Z. Let k > and p > denote the respective jump rates of X and Y if 
they are continuous time random walks, and set k + p = 1 if they are discrete time random walks. Then 
almost surely with respect to Y, as t — > oo, Kq k\ for each A; G N, and 

2Tr{K+p)y^dctQLt{X,Y) (conditioned on Y converges in distribution to a mean 1 exponential random variable. 

Remark. If Z is reducible, e.g., when X and Y are discrete time simple random walks on 1?, then 
Q needs to be replaced by the covariance matrix of an image random walk, namely, the random walk 
obtained from Z after one applies the linear map which maps the set of sites in 1? that Z visits with 
positive probability bijectively to Z^. 

Remark. The analogue of Theorem 11.21 fails for dimensions d ^ 2. Consider the discrete time case. 
For (i > 3, by the transience of the random walk X — Y, a.s. w.r.t. X and Y, Ln{X,Y) increases to 
a random constant Loo(X,Y) as n — > oo. With respect to the joint law of X and Y, Loo{X,Y) is 
geometrically distributed; however conditioned on Y, the law of Loo{X, Y) clearly depends sensitively on 
the realization of Y. For d = 1, the correct scaling for Ln{X, Y) is n^^/^. Under diffusive scaling, {X, Y) 
converges in law to a pair of independent Brownian motions {Bi,B2), while up to a constant factor, 
Ln{X,Y)/y/n converges in law to the collision local time Li{Bi,B2) between Bi and B2 up to time 
1. Thus as random probability distributions, the law of Ln{X,Y)/^/n conditioned on Y is expected to 
converge to the law of Li{Bi, B2) conditioned on B2. However, such a convergence will only take place 
in probability instead of a.s., because the law of Ln.{X,Y)/ ^/n conditioned on Y depends sensitively on 
the rescaled path (li/\/ri)o<j<r!.i which a.s. does not converge as n ^ 00. We will not pursue the d = 1 
case in this paper. 

Our original motivation for the study of the law of Lt{X,Y) conditioned on Y stems from the 
parabolic Anderson model where the random medium consists of a single moving catalyst: 



d_ 

— v^,-. . -v^,-., xez^^>o, (1.2) 

u{0, x) = 1, 



— n(t, x) = KAuit, x) + -f6Yt (x) u{t, x), ^ ^ 



where k > 0, 7 G M, A/(x) = ^Yl\\y-x\\=iifiy) ~ /(^)) discrete Laplacian on Z'^, and Yt is a 

simple random walk on Z*^ with jump rate p > 0. By the Feynman-Kac representation. 



u{t,x) =E: 



exp I7 J 6o{Xs - Yt-s)ds 



(1.3) 



where X is a simple random walk on with jump rate k and starting from x. Note that if not for the 
time reversal of Y in (jl.3p . the exponent in (jl.3p would be exactly 'yLt{X,Y). 

The annealed Lyapunov exponents = limf^oo logIE^[u(t, 0)*^], G N, were studied by Gartner 
and Heydenreich in |GH06j . For the quenched Lyapunov exponent A = limt_>oo log w(t, 0), we can 
replace ii(i,0) by Ug^, where 



exp I7 j 5o{Xa - Yt^a)da^ l{Xi„,=Y4 



< s < t. (1.4) 
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It turns out that A = limt_>oo t ^ log u{t, 0) 
applied to logn^ j, it can be shown that 



linif^oo i ^log^iot- By the superadditive ergodic theorem 



A = sup J E^[loguo,t] = sup J Eq 

t>0 ^ i>0 I 



logE^[e-^*(^'^)l^^, 



:i.5) 



where we have reversed time for Y in the second equality. There exists a critical 7c G M such that A = 
if 7 < 7c) and A > if 7 > 7c. It can be shown that 7c = in dimensions d = 1,2, and 7c > in d > 3. 
The proof of 7c = in d = 2 is the most subtle one, and the only proof we know of at the moment uses 
the representation (jl.Sp and Theorem II. 2i The details are contained in Birkner and Sun |BS08j . 

A closely related model where the conditional law of Lt{X,Y) arises naturally is a pinning model. 
More precisely, we define a change of measure from the random walk path measure P on (ALs)o<s<t with 
Radon-Nikodyn derivative 

„-yLt(X,Y) 

(1.6) 



HP"' 



dP 



where Z^y 



X^X)'^ is the normalizing constant. With respect to the measure -P^y random 



walk X prefers to be at the same location as Y when 7 > 0. This model exhibits a localization- 
delocalization transition. Namely, there exists a critical 7c E M such that if 7 < 7c, then for typical 
Y and typical X w.r.t. -P^y ^ spend negligible fraction of time together; while if 7 > 7c, then 

for typical Y and typical X w.r.t. -P^y ^ spend positive fraction of time together. By the 

same argument as for the parabolic Anderson model (jl.2p . it can be shown that limt_>oo log^/y 
so-called free energy, exists almost surely and equals A in (jl.Sp (see |BS08j for details) . This implies that 
7c = in d = 1, 2, and 7c > in (i > 3. For more on pinning models in general, see Giacomin [GOT]. 

Another model where the conditional law of Lt{X,Y) appears is the directed polymer model in 
random environment. See Birkner |B04] for a sufficient condition for weak disorder which is formulated 
in terms of the law of Lt{X, Y) conditioned on Y. 

The exponential law arises in many different contexts in the study of the local time of two-dimensional 
random walks. Another interesting instance is a result by Cerny |C07j that, almost surely with respect 
to the path of a non-degenerate zero mean finite variance random walk on Z^, as t ^ 00, the law of the 
local time at time t sampled uniformly among all sites visited by the walk up to time t, and rescaled by 
a factor of 1/logt, converges to the law of an exponential random variable. 



To end the introduction, we propose an interesting open problem. 

Open Problem: Fix A; > 1. Let X, Yi, ... ,Yk be independent irreducible zero mean finite variance 
random walks on starting from the origin, such that Zi := X — Yi, 1 < i < k, are all irreducible. Is 
it true that as t ^ 00, a.s. w.r.t. Yi,--- ,Yk, ( ^^i^f^ , • • • , ^i^'f'^ ) conditioned on Yi, • • • , Yk 

converge in distribution to k + 1 independent exponential random variables? 

y X r Lt(X Yt) — T-^tt-"-'*^) -| -| 
Preliminary calculations of expressions of the form E^^ [E^ [ \o t ^ JJ, assuming the quan- 

tity inside E^^ [•] asymptotically self-averages, favor the affirmative. However, we will not go as far as to 
formulate it as a conjecture here. 



2 Preliminary Lemmas 

In this section, we prove two lemmas, 12.11 and 12.21 which we will need to prove Theorem 11.21 in Sec. [3l 

Lemma 2.1 Let Z be an irreducible zero mean finite variance random walk on 1? with covariance matrix 
Q. Letp^{-), resp. Pt{ ), denote the translation invariant transition probability kernel for the case Z is a 
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discrete, resp. continuous, time random walk. Then there exists < C < oo such that for any x, zq G 
{with Pn {x)Pn [x + Zq) > Q for some n in the discrete time case), we have 

°° / 1 1 \ 

ElpfW-pf(x + .o)l <CN|| (rqrM + i + ||. + .o|| j ' 

where \\ ■ \\ denotes Euclidean norm, and in the continuous time case, 

oo / 1 1 \ 

\pf{x) - pf{x + zo)\dt < C\\zo\\ -—--r + ^^11 ^ II . (2.2) 

Remark. The analogue of Lemma 12.11 for random walks on Z"^, d > 3, is to replace 1 + ||3;|| and 
1 + ||x + zoll respectively by (1 + and (1 + \\x + zqH)'^"-'^ in (|2.1|) and (|2.2p . which is easily seen if 

we replace pf by transition densities of Brownian motion. However, such a result can not hold in general 
without additional assumptions. In particular, for d > 4, we can define a discrete time random walk 
pf (•) with pf{±ei) = l/4d for each 1 < i < d where Cj are the unit vectors in Z*^, (ita^ei) = Cn~'^a~'^ 
for an increasing sequence of a„ G N, and Pi{x) = for all other x G Z"^. If a.„ increases so fast that 
pf (±a„ei) > Ca~'^~'^ for some e > 0, then \pf{x-\-ei) —pf{x)\ already violates the desired decay in ||x||. 

Lemma 2.2 Let X he an irreducible zero mean finite variance random walk on 1? . Let q G [1,2). Then 
for all V ^1? and i G N {replace i £ by s > 1 in the continuous time case). 



(l + ||x-v||;- 12 



{X,=x)——^ ^<TT> (2-3) 



where Cq is a constant depending only on q and the walk X . 

To prove Lemma [2. H we will use the following expansion form of the local central limit theorem from 
Lawler and Limic |LL08j (see Theorem 2.3.8 there for a slightly different formulation). In [LL08| . this 
result is stated and proved for discrete time random walks, however it is clear that the same proof and 
result hold for continuous time random walks. 

Theorem 2.1 [Lawler & Limic] Letpn{ ) he the transition probability kernel of an irreducible aperiodic 
mean zero random walk on with finite [k + l)-st moment for some integer k > 3. Let Q be the 
covariance matrix of the random walk. Then 



Pn{x) 



(27rn)'^/2VdiFi 



^ U3{x/^/n) ^ u^{x/^/n) ^ ^ Uk{x/y/n) 



+ e„,fc(x), (2.4) 



where there exists < c < oo such that 

|^^j(^)| <c(||z||^>l), (2.5) 

and uniformly in x and n G N, 

\^r^,k{x)\ < ^^d+k-l)/2 - (2.6) 

For a rate 1 continuous time random walk, (\2.4\)~(\2.6\\ hold with n G N replaced by t > 1. 



Proof of Lemma 12.11 Initially we only had a proof of Lemma 12.11 for a restricted class of random 
walks. Greg Lawler kindly showed us how to extend the result to all irreducible zero mean finite variance 
random walks. We present his line of arguments here. Most ingredients can be found in his book with 
Vlada Limic |LL08| . The main idea is to use the finite range coupling of random walks. 
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As a remark on notation, since we will not be concerned with the exact values of the constants in our 
estimates, in what follows, unless stated otherwise, c, C, Ci, C2, etc, will denote generic constants whose 
values may change from line to line. 

We only treat the discrete time case. The continuous time case is similar. Without loss of generality, 
we may assume that Z is aperiodic, otherwise we can partition N into periodic subsets and change time 
scale to reduce to the aperiodic case. It is not difficult to see that the one-step transition kernel 
allows a decomposition (see Exercise 1.3 in |LL08j ) 



p^{x) = ap^^\x) + (1 - a)p^'^\x), 



(2.7) 



where a can be chosen in (0, 1/2), p^^^ is the one-step transitional probability kernel of an aperiodic mean 
zero finite range random walk, and p^"^^ is the one-step transition probability kernel of an aperiodic mean 
zero finite variance random walk. Thus a p^ random walk at each step chooses a jump according to p^^^ 
with probability a, and according to p^'^^ with probability 1 — q. A coupling between two p^ random 
walks with different initial positions is called a finite range coupling if they choose the same transition 
kernel from {p^^\p^'^^} at each step, they make the same jumps if p^"^^ is chosen, and the jumps are 
suitably coupled if p(^) is chosen (see e.g. Proposition 2.4.2 and Lemma 2.4.3 in |LL08j ). Let Qi and Q2 
denote respectively the covariance matrices of p^^^ and p^'^\ If denotes the sum of n i.i.d. Bernoulli 
random variables with parameter a, then 



\Pnix)-Pnix + Zo)\ 



Y^nMn = 3) [pf (') - pf (^ + ^0)) p^n-ji^ - Z) 

j=l z<a? 



< Y.nMn=j) \pf {Z) - Pf\z + Z,) p[f^( 



[X — Z). 



{21 



Since p^^^ has finite range, by ()2.4p . it is easy to check that if e is a unit vector in 1? such that 
X ■ Q^^x < (x -\- e) ■ Q'^^{x + e), then for any integer /c > 3, we have 



\pI.'\^) - Pl.'\x + e)\ < — 

712 



1 + 



fc+1' 



e 2n -\- q(ji 2'^ 



{2S 



uniformly in x and n. This bound and the local central limit theorem applied to p^"^^ are all we need to 
bound dlSI) and establish (|2T|) . 

Let R = max^.g22{||x|| : p^^\x) > 0}. Applying ()2.9p with k = 5 then gives 



E \P^n\x)-P^n\x + e) 



E \P^n\x)-p^^\x + e) 

|lx'||<_Rn+l 



< 



< 



2c 



E - 

||a;||<_Rn+l 



1 + 



xU-. X 



e 2n + 



C 



n 



C 



n 



(2.10) 



where on the second line, the factor 2 takes care of the possibility that (x + e) • Qi^{x + e) < x • Q^^x, 
C is uniform in n G N, and for the last inequality we used the Riemann sum approximation. By the 
triangle inequality, 

El^'^^'^(^)-^'^'^(- + -o)|<^ (2.11) 

with C uniform in zq G 1? and n G N. Using the decomposition ()2.7p . it is easy to check that ()2.1ip in 
fact holds for all irreducible aperiodic random walks on Z'^ (see Proposition 2.4.2 in |LL08| ) . 
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By the symmetry of (j2.ip in x and x + zq^ we may assume without loss of generahty that 

x-Q^^x<{x + zq)-Q^^{x + zo). (2.12) 
To bound {x) — Pni^ + zq)\, we separate the sum into three regimes: 

(1) n>(l + ||x||)2; 

(2) 1 < n < C iog(2+||i||) some c > sufficiently small; 

For the regime n > (1 + ||x||)^, by ()2.8p . (12. lip and the local central limit theorem for p^'^\ 

|pfM-p,f(x + .„)| < ■rP(M„=j)3M-— ^ (2.13) 



< llzoll (cp(|M„ - an\ > + 
where we used elementary large deviation estimates for Mn/n. Therefore 



C 



n=(l+|lx||)2 n=(l+||a;||)2 " " 

for some C uniform in x,zq £ 1? . 

Now let 1 < n < c(l + ||x||)^/log(2 + ||x||) with c > to be chosen later. By our assumption (j2.12p . we 
have ||x + zo|| ^ 2e||x|| for some e G (0, 1/2) depending only on the smallest and largest eigenvalues of Qi- 
Since p^^^ has mean zero and finite range, by Hoeffding's concentration inequality |H63] for martingales 
with bounded increments, uniformly for all 1 < j < c(l + ||2;||)^/ log(2 + ||3;||), we have 

E vf{z) < Cie"^^^ < C^e ^^^(™^ < \ (2.15) 

\\z\\>e\\x\\ U + FIIJ 

provided we choose c < C2e^/3. By (|2.8p . 

n 

|pf(x)-pf(x + zo)| < J2P(Mn=j) E |pf (^)-Pr(^ + ^o)|^'i-.(^-^) (2-16) 

j=l ||2:-x||<€||z|| 

71 

+ E ]P(^n = j) E l^^r (^) - + I ^'i-.- - ^) • 

j=l |j2;-x||>e||x|| 

Since we have assumed ||x + zo|| > 2e||x|| for some e G (0, 1/2), ||z — x|| < e||x|| implies ||z|| > (1 — e)||x|| > 
e||x|| and \\z + zqII = II (^^ + ^o) + (-^ — 2;)|| > e||x||. Therefore by (j2.15p . the first sum in ()2.16p is bounded 
by (xqq^iiyT- On the other hand, we have the following version of local central limit theorem for p^"^^ (see 
Section 7, PIO of [S76]), 
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where C is uniform in j and y. Combined with (j2.1ip and large deviation estimates for Mn/n, this 
implies that the second sum in (12.160 is bounded by ^^^^||j|,||-|2 for some constant C depending only 
,p^^^ and p^^^ Therefore 



, (i+ll^ll) . 

'log(2+||a:||) 



2cC(l + ||x| 



+ 



C\\zo\ 



-log(2+||a:||) 



n=l 



(l + ||x||)3log(2 + ||x||) (1 + ||X||)2 



n=l 



+ X 



(2.18) 



Finally, we treat the regime c(l + ||x||)2/ log(2 + ||x||) < n < (1 + ||x||)2. By large deviation estimates 



for Mn/n, it is easy to verify that 



(i+ll^ll)' 



n-c (i+ll'll)" I . '-i^" 

log(2+||i^||) |j-cin|>an/2 



+ X 



(2.19) 



So we focus on an/2 < j < 3an/2 in (j2.8p . 

By the local central limit theorem for p^'^\ we have p[^\y) < ^ uniformly for all y G and i G N. 
Combined with ()2.17p . this implies that 



p?\y)< 



c 



iV(l + 



(2.20) 



for some C uniformly in y G and i G N. Therefore for all an/2 < j < 3an/2 and x, z £ Z^, we have 



(2) ^ \ ^ <^ 

K./x -z) < 



n V (1 + ||x — z\ 



\2 ■ 



(2.21) 



If = 0, wi, • • • , = is a nearest neighbor path in from to zq, then by similar computations 
as those leading to (|2.1Up except we now apply (j2.9p with A; = 8, we get 



Y \Pj (^) -Pj (z + zo) Pn-,j{x - z) 



L 



r=l , 
L 



c 



< 



< 



c 



E E ^-3/2 



'■=1 \ 

L 



1 + 



\Z + Vr 



EE 



r=l , 



n- 



C_ 

J/2 



1 + 



nV {l + \\x- z||)2 

e~ 2, £ 
n V (1 + ||x - z||)2 j2 



Z-Q-, z 



e 2n 



+ 



n V {1 + \\x + Vr — z\\)^ 77,2 



(2.22) 



For any y G Z2, we have 



Note that by Riemann sum approximation, 

9' 



E 



1 



n 



1 + 



\z\ 



e 4ii 



[1 + \\w\\ )e 4 dw < oo. 



It is then easy to see that in (|2.23p . the first sum is bounded by ^^3726 
bounded by ^|--^^^|^||^2 ? where Ci, C2 and C3 are uniform in y e and n G N. Hence 



and the second sum is 



E 



C 
3/2 



1 + 



e 2n 



nV(l + ||y-i||)2 - n3/2 



C3 



< 



C7 



^{l + \\y\\)2 - ^(l + ||y||)2- 



(2.24) 



By our assumption ()2.12p . which impHes \\x + zo\\ > 2e||x|| for some e € (0,1/2) depending only on 
Qi, we can choose the nearest neighbor path vq = 0,vi, • • • ,vl = zq such that L < C||2;o|| for some C 
independent of x and zq, and \\x + Vr\\ > e||x|| for all < r < L. For such a path, we can substitute the 
bound (p:2i|) into (p:22]) to obtain 



^ P(M„ = i) ^ |p«(^) - pJ^H^ + ^0) - ^) < 7^ 

,„ I . /n _^';75' V V 



(1)/ 



.(2) 



C\\zo\ 



\j —an\<an/2 z£ 

Combined with (j2.19p . we see that 



+ 



C\\zo\ 



(2.25) 



(i+ll^ll 



C\\zo\ 



'log{2+||a;||) 



+ X 



(2.26) 



with C uniform in x,zq £ 1? . Together with (j2.14p and (j2.18p . this proves (|2.1 



To prove Lemma 12.21 we will use the so-called rearrangement inequality. For much deeper results on 
rearrangement inequalities than the one we use here, see Chapter 3 of Lieb and Loss [LLOlj . 

Lemma 2.3 Let (a„)„,gN a non-negative non-increasing sequence, and let (6„)„gN and {cn)n£N two 
non-negative sequences. If c majorizes b in the sense that X^ILi bi < S"=i Q for all n £ N, then 



(2.27) 



n=l 



n=l 



In particular, if there exists a bijection a : N — > N such that (6CT{n))n6N becomes a non-increasing sequence, 
then 



^ anbn < ^ anb„ 



(n)- 



(2.28) 



n=l 



n=l 



The proof of Lemma 12.31 is elementary, so we omit it. The majorization condition can be interpreted as 
a stochastic domination condition for the positive measures on N defined by b and c. 



Proof of Lemma 12.21 We only treat the discrete time aperiodic case. The discrete time periodic case 
and the continuous time case are similar. Let (x„)„gN be an ordering of in increasing Euclidean norm. 
Clearly the sequence ^jqq|^r-[|j^ , n G N, is non- increasing. Let (yn)n6N be an ordering of such that 
¥{Xi = Un) becomes a non-increasing sequence. Then by the rearrangement inequality (j2.28p . 

1 . 1 



fl + llx - v\\)i 



< 



n=l 



(1 + lknll)^- 



(2.29) 
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Let Q denote the covariance matrix of X. By the local central limit theorem, P(Xj = x) = ^ i-ni^e^Q^^ 
uniformly in x. Since is positive definite, we can choose C and a independent of such that 



(P(Xj = ?/n))neN is majorized by (as defined in Lemma [2T3]) the sequence (6„)n6N with hn = 
when < and bn = when ||x„|| > Vi. Then by (j2.27p . 



By Riemann sum approximation. 



lim i'?/^ y c , „' „, = lim y C— ^ - = C \ „ „ dw, (2.31) 



which is finite if g < 2. In view of ^IJM and (|230]) . this implies (l23|) . 



3 Proof of Theorem [12] 

Since the proof of Theorem 11.11 is rather simple, we include it here for completeness. 

Proof of Theorem 11.11 We give the proof for the continuous time random walk case. The discrete 
time case can be treated similarly, or it can be deduced from the continuous time case by a change of 
time argument. Let Vtix) = F{Xt = x\Xo = 0). Note that for each k G N, 

rt 



E 



• • • X. 



[ dsi-- - [ dsk¥{Xs, 
Jo Jo 



k\ [ dsips.iO) [ ' d.S2PsM' 
Jo Jo 



0) 



Psk{0)dsk. 



Clearly 



t/k 



PsiO)ds 



< 



kl 



< 



Ps{0)ds 







(3.1) 



By the local central limit theorem, pt(0) 



Therefore /;V.(0)^. ~ 



27rrtVdet ( 

for any c > 0, and 



p where we write f{t) ~ g{t) if limt^oo f/g = 1- 



lim E 



2TTry/detQLt\k 
logt 



k\ . 



(3.2) 



Since k\ is the A;-th moment of a mean 1 exponential random variable and is distribution determining, 
the desired convergence in distribution follows by the method of moments. I 



Proof of Theorem II. 2L For simplicity, we write Lj for Lt{X,Y) from now on. We divide the proof 
into three parts. First we treat the discrete time case and show that for each A: G N and e > 0, 



Var(E^[L^^|y]) = (e^[L>^\Y] - E^/[L'^] = o(log^ 



n), 



(3.3) 



which implies a weak law of large numbers for Eff [L^ | y] / log'^ n as n ^ oo. We then show how to adapt 
the argument to the continuous time case. Lastly, we show that our variance bounds in fact imply a 
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strong law of large numbers for Eq [L(^|y]/ log ' n. The claimed almost sure convergence in distribution 
for QL„(x,Y) ^j^gj^ follows by the method of moments. 

log n 

Variance bound for discrete time random walks. Let denote the sigma-field generated by 
(l^)o<i<n- By the martingale decomposition, for any fniX) measurable w.r.t. F^^ we have 



^lUn - E-^IU])^] =Y,^l [K[/n|F.] - ^l[fn\F,-l]Y 



(3.4) 



i=l 



We now estimate the i-th term in the summation. Note that (E^[/„|Fj] — E^[/„|Fj_i])^ depends only on 
(l^)i<j<j. Let us first integrate out the last jump Yi — Yi-i. By the standard trick that E[(Z — E[Z])^] = 
iE[(Z — Z')^] where Z' is an independent copy of Z, we have 

v2 



E, 







E^[fnm]-E^[U\F.i]) 



F-1 



2 



E^[MF,_i,y, - y,_i = A] - E^[U\F,.i,Yi - Yi^i = A' 



(3.5) 



where A and A' are independent copies of the increment of Y in one step, and hence 



E, 



y 



El\UFi\-El\UFi_^\) 



-E' 



A, A' 



E, 



Y 



El\UFi_^,Yi-Yi_^ = A\-El\U\F,.x.Yi-Yi-x = A, A' 



(3.6) 



We now specialize to the case /«(y) = E^[L^(X, y)|y] for some fixed A; G N. Write L„ = -Z^[o,j-i] + 
^i,n\ where L\^a,h\ = Y.a<j<b^o{Xj - Yj). Then 



rk rk , \ ^ / ^ 1 rk—m jm 

W - ^[0,i-l] + 2^ [mr[0,i^l]Hi,r 
m=l ^ ^ 



(3.7) 



Write A, resp. A', as a shorthand for the conditioning Yi — = A, resp. A', and let pf{-) denote the 
i-step transition probability kernel for X. Then 

E^[/„|F,_i,A]-E^[MF,_i,A'] 

m=l ^ ^ 



(3.8) 



If we denote = y, and denote Z = X — Y , then we have 
E^[/„|Fi_i,A]-E^[/„|Fi_i,A'] 
k 



^0,6 [-^M I ^i-i, A',Xi 



(3.9) 



m=l 



E [jj Y.P^^'^) E^[L\^^l^_^^\n.uX.=x] (Ef_,_^[L™_,(Z)]-Ef_^_^,[L-,(Z)]). 



where Ln{Z) = X^"=o '^o(-^j)- It is easy to see that 



E^[/„|F,_i,A]-E^[/„|Fi_i,A'] 



^ CkY.\Y.Pf^'^)^o[L\^Jl^\F^-l,X, = x] Ef„,„^[L™,(Z)]-Ef_,_^,[L-,(Z)] 

m=l \xeZ2 



(3.10) 
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Here and as well as in what follows, Ck always denotes a generic constant depending only on k and the 
transition kernels of X and y, whose precise value may change from line to line. 
By expanding = (Eo<i<n '^oC^i))"*, we have 



< 



Z,^ = 0) - ^Ly-A'{Zn = --- = Z,^=0) 



m—l 



0<ii,--- ,jm<n~i 

< ml Yl \Pni^-y-^)-Pn(^-y-^')\Pn-ni^)---pL-,r.-ii^) 

0<ji<j2---<jm<n 

< ml \pI{x - y - A) - pI{x - y - A')\ i ^ pf^(O) 

0<ii<oo \0<j2<n 

< c,(iognr-i \Pn{^-y-^)-pfA^-y-^') 

0<ji<oo 

1 1 



< Cfc(lognr-i||A- A' 



+ 



l + ||x-y-A|| l + \\x -y - A'WJ ' 



(3.11) 



where in the last two inequalities, we used the local central limit theorem which implies that (0) < cn ^ 
for some c > 0, and we applied Lemma [2?T1 Substituting (j3.1ip into (jS.lOp . we get 



E^[/„|F,_i,A] -E^[/„|F,_i,A'] 

k 



< C,j:(logn)2(--)||A-A'||M Y E^^(^) ll, 

. I . . , _„ 1 + \\x — y — v\\ 



m=l 
k 



^v=A,A' a:eZ2 



E^[L'-^r^^m_,,Xi = x] 



< C..j:(logn)2(-i)||A-A'f Y [Epf(^)^l 



m=l 



v=A,A' 



+ \\x — y — v\ 



(3.12) 



Let q E (1, 2) and p £ (2, oo) with i + i = 1. We now apply Holder's inequality and Lemma 12.21 to 



obtain 



< 



Y p^^^^^ 



1 + \\x — y — v\ 
1 

{l + \\x-y-v\\y 



(3.13) 



Substituting (|3.13p into (j3.12p then gives 

(E^[/„|Fi_i,A]-E^[/„|F,„i,A': 



< Cfc^(logn)2( 



1) 



|A- A 



/||2 



m=l 



1+ ^pf(x)(E^[Lf,-;;-,|F,_i,X,=x])"). (3.14) 
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The important point here is that we obtain a factor of i. We can now substitue this estimate into ()3.6 
with /„ = E(f [Li (X, y ) I Y] to get 



Ea/n|Fi]-E^[/„|F,„i]) 



< 



A,A'[||^_^/||2] k 



5](logn)2(™-i)(l+ ^pf(x)Eo^ (E^[Lfo-;,-,|i^„i,X,=x])^ ).(3.15) 



m=l 



Since p > 1, applying Minkowski's inequahty (an integral version of the triangle inequality on Lp space, 
see Section 2.4 of Lieb and Loss [LL01| ) 



\f{x,y)\u{dx)] n{dy) < 



\f{x,y)\P^i{dy)Yu{dx 



(3.16) 



to the two fold expectation in (j3.15p with Eg [•] playing the role of J ■fi{dy) and Eq [-iXj = x] playing 
the role of / •h'{dx), we get 



E^ 



TwiX r T k~m 
^0 L^[o, 



\Fi_i,Xi = x\ 



<E^ 



L 



[0,i-l] 



{Xj)o<j<i 



Xi = X 



(3.17) 



The advantage of estimating the RHS of (|3.17p over the LHS is that, we have a good uniform bound 



on E^ 



L 



(k—m)p 
[0,i-l] 



|(Xj)i<j<j with respect to (Xj)i<j<j, which allows us to circumvent the conditioning 

on Xi = X. More precisely, by the local central limit theorem for Y, we have Pniu) ^ ^ foi' some C 
uniformly in n G N and y £ 7?. Hence by Holder's inequality and the same expansion of -^|o„] as the 
one leading to (j3.1ip . we get 



E^ 



^[0,i-l] I 



j)0<j<i 



L 



\(k—m)p~\ 
[0,n] 



{X, 



j)0<j<n 



(k — m)p 
f(fc-m)pl 



< Cfc,p(logn) 



(k—m)p 



(3.18) 



uniformly in (Xj)o<j<n,. Substituting this bound into (|3.17p . ()3.15p and then into (|3.4p . and combining 
various constants together, we get for /n(5^) = I^q" 



n 



.2m—l+(k—m)p 



(3.19) 



i=l m=l 



m=l 



where C depends only on p, A;, X and Y . Since p > 2 can be chosen to be arbitrarily close to 2, we see 
that Var(EQ- [L^|y]) = o(log^^^^''"^ n) for all e > 0, which is what we set out to prove. 

Variance bound for continuous time random walks. We now adapt the above argument to 
continuous time random walks, which is a bit more cumbersome. Without loss of generality, assume 
t = n G N. The martingale decomposition (j3.4p is still valid. However, in (j3.5p and (j3.6p . instead of 
conditioning on Yi — Yi-\ = A, resp. A', we need to condition on (Yi-i+s — ^t-i)se[o,i] = (^s)sg[o,i]) 
resp. (A'^)5g[o.i] . We also need to replace (j3.7p by 



rk _ rk I f ^ \ Tk-m rk 

- ^[0,i~l] + 2^ 1 m J^[0,i-l]^[i-l,n]- 
m=l ^ ' 



(3.20) 



To extract ^^-^ as a common factor as in (|3.8p . we should now condition on = x rather than on 

Xi = X. Writing simply A as a shorthand for the conditioning {Yi_ij^g — yi-i)s(=[o,i] = (^s)se[o,i]i and 
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the same for A', (j3.8p is now replaced by 

E^[/jF,_i,A]-E^[/„|Fi_i,A'] 

A: 



m=l ^ ^ x&? 

In (13.211) . we make the further expansion that 

m / X 

jm _ \ " / \ rm-i 

The resulting expansion for p.2ip then consists of the following three types of terms: 



(3.21) 



(3.22) 



-1 = x\ 



r^;„ / >1 : j;pj^i(x)E^[Lf,-;;™,|F,_i,x,„i = x]Ej5^[4„i^,,]L-;(^ 



X 



Therefore 



Ej[A|F,_i,A]-E^[MF,_i,A'] 



k m 



m=l 1=1 

k m 



k\ fm 



k m 



m,l 

-EE 



m=l 1=1 
k m 



k\ fm 



ml \ I 



ml 



^m J \ I 

' ) 

\m=l m=l 1=1 m=l 1=1 / 

where Ck is a constant depending only on k. To bound the variance as in (13. Sp . we need to bound 



S cJi: r-;n +EE ri< +EEK 



(3.23) 



E 



A, A' 



y r/'T-A,A'\2 



m,0 ; 1^' 



A,A'l 



E' 



A, A' 



and E 



A, A' 



For terms involving T^q , 1 < jtt, < A:, if we denote Yi^i = y and by further conditioning on Xi = x' , 
we then have 



E, 



^ .^^'^ [L|-„] I A, = x] - E^^^ [L|^„] I F,_i, A', = x] 
< ^ p^x' - x) Ef,_^_^^ [L^,(^)] - Ef,_^_^, [L- ,(Z)] 



< C7,(logn)™-i||Ai-A;|| E E T 



(x' — x) 
+ \\x' — y — v\ 



(3.24) 



i>=Ai,A'j x'&I? 

where Z = X — Y ^ and we followed the same computation as in (|3.1ip . Since X has finite second 
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moments, by the Markov inequality, we have 

< IP^(ll^ill> 
C 



+ \\x' — y — v\ 



+ 



\\x' —x\\ < 



'^^p 1 I II / 1 

i+\\x-y-v\\ i ~r ~ y — V\ 



< 



< 



+ 



sup 



||x'-x||< 



1 + llx — y — — — x\\ 



c 



(3.25) 



1 + \\x — y — v\y 

where C and C are constants depending only on X. This reduces the bound for (r^'^ )^ to the same 
form as in (j3.12p . The calculations for the discrete time case then carry over, and we conclude that the 
contribution of terms involving T^'q to the variance of E^[L^|y] is of order o(log2'=-^+^ n) for all e > 0. 

We now boundE^'^' E^[(r^^;) |A,A'] , 1 < / < m. The case involving T^ ^ is identical. By first 

conditioning with respect to Xi = x' and then applying the local central limit theorem as in (|3.18p . and 
using the fact that Lrj_i ji < 1 and / > 1, we get 



E, 



0,0 



jl rm—l 



A,Xi_i = X 



< 



C(logn)™-^Ef_y^_jL[o,i](X,A)]. 



Hence 



(logn)-2("-0E^'^'[E^[(r^,)>^A'] 



(3.26) 
(3.27) 



<CE^'^' 



< CE^E^ 



E, 



Y 



5]p^^i(x)E^[Lj;,-™j|F,_i,X,_i=x]Ef_y^_jL[o,i](X,A)] A,A' 



^pf_,(x)(E^[L|;-;,- 



J]pf_i(x)(E^_y^_jL[o,i](X,A)] 



where we have applied Cauchy-Schwarz. Note that the first inner sum above does not depend on A; 
while conditioned on for the second inner sum above, we have for i > 2 



E^[ P^^i(x)(Ef_^^_^ [^[0,1] (^, A)' 



< E' 



:x)^x-Y^ 



x£2 



I J^P^y) J^p^^i(x)pf(yi-i + 2/-x)ds 

^ Y,P^s{y)pf-i+s{yi~i + y)ds<^, (3.28) 



where we again used the local central limit theorem, and C depends only on the transition kernel of X. 
Therefore, from (j3.27p we get for i>2 



E 



A, A' 



< c 



i - 1 

(logn)^('^^') 



Y,pI,{x)(e^[lI-;_! \F,.^,X., 



i-i = X 



(3.29) 



which follows by the same calculation as in (IXTTI) and (IXTHI) . Note that ^ = when i = I. bummmg 
over 1 < i < n, we see that the contribution of terms involving T^ ^, / > 1, to the variance of E^[L^|y] 
is of order 0(log^'^~^ n). This completes the variance bound for the continuous time case. 
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Almost sure convergence of E^[L,^|y]/ log'^ n. Because of the monotonicity of Efj^[L^|y] and log'^ n in 
n, we can apply the standard argument of first establishing almost sure convergence of Eg" [i^^ I ^] / ^os'^ ^ 
along a subsequence in N (or in the continuous time case), and then use the monotonicity to bridge 
the gap. 

We will only treat the discrete time case. The continuous time case is identical. Fix /c G N. By The- 
orem [TTTl lim„^oo E^Q^[L^]/ log'^ n = k\/{27^^/detQ)'', where Q is its covariance matrix of the random 
walk Z = X — Y . By the variance bound (|3.3p . we have for any 6 > 0, 

3 

Along the subsequence tm = e"^ , m G N, by Borel-Cantelli, 

E^[Lj^ \Y] k\ ^ ^ , , 

lim — , , = , almost surely. (3.31) 

(log *„,)'= (27rVditQ)'= 

For any tm < tm+i, by the monotonicity of EQ'[L^|y] and (logn)*^ in n, we have 

m ^^[Lt\Y] ^ E^[Lt\Y] ^ E^[L^;|y] ^ ^^[LtjY] ^ E^[Lt^jy] / rn±l^ 

m + lj (logtm)'' (logtm+i)*^ ~ (logn)^ ~ (logtm)^ (logtm+i)^ V 

It is then clear that lim„^oo E^[Lj^|y]/(log n)'^ = A;!/(27ri/det Q)'' almost surely w.r.t. Y, and Theorem 
11.21 follows by the method of moments. I 
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